Reinforcement Learning–Based Energy Management Strategy for a Hybrid Electric Tracked Vehicle

نویسندگان

  • Teng Liu
  • Yuan Zou
  • Fengchun Sun
  • Joeri Van Mierlo
  • Ming Cheng
  • Omar Hegazy
چکیده

This paper presents a reinforcement learning (RL)–based energy management strategy for a hybrid electric tracked vehicle. A control-oriented model of the powertrain and vehicle dynamics is first established. According to the sample information of the experimental driving schedule, statistical characteristics at various velocities are determined by extracting the transition probability matrix of the power request. Two RL-based algorithms, namely Q-learning and Dyna algorithms, are applied to generate optimal control solutions. The two algorithms are simulated on the same driving schedule, and the simulation results are compared to clarify the merits and demerits of these algorithms. Although the Q-learning algorithm is faster (3 h) than the Dyna algorithm (7 h), its fuel consumption is 1.7% higher than that of the Dyna algorithm. Furthermore, the Dyna algorithm registers approximately the same fuel consumption as the dynamic programming–based global optimal solution. The computational cost of the Dyna algorithm is substantially lower than that of the stochastic dynamic programming.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Novel Intelligent Energy Management Strategy Based on Combination of Multi Methods for a Hybrid Electric Vehicle

Based on the problems caused by today conventional vehicles, much attention has been put on the fuel cell vehicles researches. However, using a fuel cell system is not adequate alone in transportation applications, because the load power profile includes transient that is not compatible with the fuel cell dynamic. To resolve this problem, hybridization of the fuel cell and energy storage device...

متن کامل

Implementation of real-time energy management strategy based on reinforcement learning for hybrid electric vehicles and simulation validation

To further improve the fuel economy of series hybrid electric tracked vehicles, a reinforcement learning (RL)-based real-time energy management strategy is developed in this paper. In order to utilize the statistical characteristics of online driving schedule effectively, a recursive algorithm for the transition probability matrix (TPM) of power-request is derived. The reinforcement learning (R...

متن کامل

Battery and generator sizing of series hybrid electric vehicle based on experimental data and standard cycles simulation

Hybrid electric vehicles are getting more attention due to the fuel consumption and emission issue in megacities. Energy management strategy and battery capacity are the primary factors for the energy efficiency of range-extended hybrid electric vehicles. Iran khodro Powertrain Company has unveiled a series of hybrid electric vehicles and is improving its performance constantly. In the present ...

متن کامل

Reinforcement Learning Based Adaptive Energy Management on Diverse Applications for Embedded System

Use of adaptive energy management strategies is essential in improving energy utilization, efficiency, and sustainable operation of embedded systems. Accordingly, this paper presents embedded system applications, which are suitable for employing adaptive energy management utilized reinforcement learning. We proposed rewarding function for embedded system applications in stimulating the learning...

متن کامل

Energy Management Strategy for a Hybrid Electric Vehicle Based on Deep Reinforcement Learning

An energy management strategy (EMS) is important for hybrid electric vehicles (HEVs) since it plays a decisive role on the performance of the vehicle. However, the variation of future driving conditions deeply influences the effectiveness of the EMS. Most existing EMS methods simply follow predefined rules that are not adaptive to different driving conditions online. Therefore, it is useful tha...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2015